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RELATIONS KIP BETWEEN AIR FORCE OFFICER QUALIFYING TEST SCORES 
ANO SUCCESS IK AIR WEAPONS CONTROLLER TRAINING 



I. IHTROOUCTION 

Objective 

The primary objective of this study was development of a selection strategy for the air 
weapons controller Air Force Specialty Code (AFSC) 17XX career field based on the Air Force 
Officer Qualifying Test (AFOQT). At the present tlk&e, this career field has no special selection 
criterion. The secondary objectives were as follows: 

1. To Investigate relationships between AFOQT composites and various measures of training 
success. 

2. To determine training performance differences attributable to background and bio* 
demographic factors. 

3. To document current aptitude levels of personnel assigned to this career field. 



Background 

Over the past several years there has been growing concern about the need for selection 

criteria for personnel entering the air weapons controller (AFSC I7XX) career field. Consents 
from training and operational personnel during the past few years have Indicated that personnel 

entering this career field have not been performing well either during training or In their field 

assignments. These concerns have been documented 1n several letters and reports (see Reference 
Note I). 



Issues 

Table T shows the attrition rates and associated costs for the five air weapons controller 
training schools (eight courses) for fiscal years 1960 through 1962. As can be seen from this 
table, the attrition rates differ widely for each school and are not stable over the years 
covered. In fact, they range from a low of 0% attrition to a h<gh of 41* attrition. Howeveri ft 
should be noticed that the rates generally increased for the 3 year period covered* especlaMy 
for the more Important courses. 

The estimated FY62 attrition costs presented In Table 1 are considered to span the range from 
extremely conservative (per course^mlnlmum) to liberal (per course-maximum)* with the actual 
costs falling somewhere within this range. Of the 537 students who entered air weapons 
controller training programs In FY62, 66 were eliminated during training. This 16* attrition 
r*te cost the Air Force between 2.3 and 4.6 million dolUrs In wasted training. Although the 
acceptability of this cost must be determined by HQ USAF and the Major Commands (HAJCOHs), 
establishment of a selection criterion for the I7XX career field appears ti be warranted. 
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Another major issue relevant to this career field Is the level of competence of the students 
once they graduate from the training courses and perform their operational dobs throughout their 
careers. At the present time, there Is no valid empirical Methodology, nor adequate -^tailed job 
performance data* that can be used to correlate student performance during training with their 
later operational job performance, HAJCOM standardization and Evaluation programs do provide 
some data concerning operational performance and are designed to ensure the operational 
competence of career field members. However * many factors may affect performance on these 
assessments » such as unit mission and tasking* training provided after formal schooling is 
completed, etc. Because of these factors* data from these assessments cannot be used to develop 
correlations between performance during training and performance In the field. Implementing an 
adequate select :on criterion, however* can be expected to have a positive effect on the 
operational performance of air weapons strollers. 

Headquarters USAF requested the Air Force Human Resources Laboratory to Investigate the 
possibility of recommending minimum cutoff scores on the AFOQT as a selection criterion for 
entrance into this career field (see Reference Mote 2), The AFOQT was chosen because It Is given 
to all potential officers (except Air Force Academy graduates) and would not Impose additional 
testing costs. 



Related Research 

Host of the previous research on selection criteria relevant to air weapons controllers has 
been done by the Federal Aviation Administration (FAA) for selecting Air Traffic Control 
Specialists (ATCSs), The FAA has experimented with various test batteries for ATCS selection 
since 1962. A review of the experience that the FAA has had with their various selection 
criteria from 1960 to 1960 can be found In Collins, Boone, and VanDe venter ( 1961} , OtNer 
articles that describe FAA selection criteria research Include Boone, VanBusklrfc and steen 
(1960), Cobb (1971). Cobb and Mathews (1973), Lewis (1976). and Mathews and Cobb (1974). 

In one of the studies most relevant to air weapons controller selection policy. Cobb (1971) 
assessed the usefulness of seven previously validated, commercially available tests in predicting 
success In military ATCS training. Although the composite test scores predicted success somewhat 
better than the military aptitude screening measures 1n use at the time (primarily* the Air Force 
General Aptitude Index and the Marine Corps Military Screening and Classification Test), Cobb 
concluded that the military could significantly improve its selection procedures by merely 
raising the minimum scores required on existing military screening tests. 



A questionnaire was developed to acquire information on course content and duration, to 
Identify students, and to obtain student performance data* ^ch as academic grades, class 
standing, and an indication of whether or not the student completed the course. This 
questionnaire *as sent to each of the five organizations responsible for training air weapons 
controllers (.»e Appendix), Each of these schools was asked to proylde data for all students 
enrolled from 1 October 1979 through I July 1979, 

Predictor data were obtained for the students Identified In the questionnaires by retrieving 
their AFOQT scores from the AFOQT consolidated data bc:t , The composites were Pilot, 
Navigator-Technical, Academic Aptitude, Verbal, and Quantitative. 



II* APPROACH 



Method 
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Table 2 shows that all of the AFOQT coiposltes were able to preclct student perforiance using 
the perforiance criteria that were chosen for this study* However* each of tht coiposltes 
yielded a different quantitative value* A closer exailnatlon of the data shows that the AFOQT 
Acadeilc Aptitude composite had the lost consistently high correlation with studtnt perforiance 
and* thus* would be the best single predictor of student perforiance* 

Figures 1 and 2 graphically show the relationship between the AFOQT Acadeilc Aptitude 
composite and success or failure fn training* As can ba seen froi these figures* students who 
failed to coiplete their training had lower scores on the AFOQT Acadeilc Aptltudt coiposlte than 
those *ho completed their training* In Figure 1» the steeper slope of the attrition line below 
the 35th percentile shows that a higher percentage of attritions (coipared to the percentage of 
graduates) occurred at the lower AFOQT acadeilc aptitude scores* Figure 2 shows lore 
specifically that* below the 35th percentile* there were lore attritions than coipletlons, while 
above the 60th percentile the reverse 1s true* There appears to be only a ilnlial difference In 
Acadeilc Aptitude coiposlte scores between those who failed In training and those who coipleted 
training for scores between the 35th and 60th percentiles* 




Figure 1, AFOQT acadeilc aptitude scores and cuiuTatlva percent graduates 
versus attritions In AFSC 1741 training* 
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Table 3, AFOQT Acadeilc Aptitude Scores and Success In AFSC 1741 
Training (Successive Percentile Slocks) 



AFOQT 

Academic Aptitude Possible 
Composite Score Cutoff Scores % Graduated * Hot Graduated 9 Difference 



01-05 




1 


3 


-2 


06-10 




2 


6 


-4 


11-15 




3 


14 


-11 


16-20 




3 


n 


-6 






ftecoMended Mlnliua Cutoff Range 






21-25 


25 


2 


6 


-4 


26-30 


30 


4 


7 


-3 


31-35 


35 


5 


11 


-6 


36-40 




6 


5 


+ 1 


41-45 




6 


6 


0 


46-50 




7 


4 


+3 


51-55 




S 


S 


0 


56-60 




6 


6 


+2 


61-65 




5 


2 


+3 


66-70 




7 


1 


+6 


71-75 




5 


1 


+4 


76-80 




3 


3 


+S 


8N8S> 




5 


2 


+3 


^vO 




7 


2 


+5 






7 


1 


+6 


9t>-9/ 




4 


1 


+ 3 



a Because jf the rounding error involved in this calculation, this column only to:als 
i7%. It does> however, include all of the appropriate data. 
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Table 5 . Correlation of Demographic Variables «fth AFSC 1741 
Training Performance Data * Total Group Input 



Criterion 


Age 
In Years 


Source of 
Commissioning* 


Hean 


SO 


N 


Academic Grade 


.117 


-.092* 


93.90 


4.82 


1186 


Succes^ 


,16^** 


-.152* 


.9154 


.2885 


1453 


Student Class Renfc 


.030 


.143** 


.5099 


.2910 


941 


Hean (Grads + Elfmlnees) 


26.65 


.630 








SD (Grads + Ellmlnees) 


3.17 


.499 








N 


156 


577 









♦Significant at .05 leval 
♦♦Significant at .01 level. 
a Source of commission was coded: 0*0TS» 1*R0TC* 
^Success was coded: 0»FAIL* I»PASS. 



A separate analysis was done to answer the question concerning whether students In these 

training programs who had previously been eliminated from undergraduate pllo training (UPT) 

performed a; well as the students without this particular background. The obta ,ed success rates 
were 913 for both groups. 

Table 6 provides data concerning how well students 1n the air weapons controller training 
programs performed on the AFOQT Verbal* Quantitative, and Academic Aptitude composites* as 
compared to personnel In several other career fields. Although the average scores for the air 
weapons controller sample are somewhat lower than the scores for the other career fields listed* 
they are higher than those obtained for the Air Force-wide officer population. This table 
Indicates that the 17XX career field Is receiving students whose abilities are roughly comparable 
to those of other critical career fields. Adoption of a selection criterion such as that 
presented In this report would result In an Increase In the average composite scores for the 17XX 
population. More Importantly, It would lower the training program attrition rate* assuming that 
there were no changes In the school attrition rate policies. Whether to adopt a selection 
criterion for this career field can be determined only by a high-level management review and 
decision process aimed at a policy that would provide an adequate number of proficiently drained 
and operationally qualified air weapons controllers* while trfntmlzlng the attrition-related costs* 



Table 6 - Mean AFOQT Composite Scores - Air Weapons Controllers 
tAFSC 1741) vs. other Career Fluids 





N 


Yerbal 


Quantitative 


Academic 
Aptitude 


UPT 


2680 


67.2 


68.6 


68.1 


AFSC 5IXX 


178 


62.4 


62.4 


67.0 


UKT 


787 


62.4 


65.5 


66 5 


AFSC T7XX a 


968 


60.4 


49.9 


56.0 


AF-Wlde 




47.4 


45.3 


45.2 


*These means 


aro only for the 


17XX students 


Included in this study. 
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The following letters and reports document concern regarding la*:k of specific selection 
criteria for the air weapons controller career field: 

Gag Ho, S. S. { 19 B? • August). Survey of S. U A. Unpublished manuscript, Z6Z5 Technical 
Training Squadron, Tyndall AFB, FL 32403-5000. 

Leec ft. J. (1981, September). Letter re: APQ student elimination, FY*1. From USAF 
Interceptor Weapons School/TQTA to USAF Interceptor weapons School/CC, Tyndal 1 AFB, FL 
32403-5000. 

North. 0. C. (1979, Hay). Letter re: Minutes of AFHRL/552 AWACw meeting concerning weapons 
director selection study. From HQ 5520 Airborne Warning and Control W1ng, 552 AWACW/DO*, to 
meeting participants* 

Pahls, G. (19B1, April). Memo for Record re: Analysis of entry level weapons controller 
training for FVBO. USAF Interceptor Weapons School, USAF IWS/TT, Tyndall AFB, FL 32403-5000. 

Rothe, H. A., Granade, B. T ., Jr., Savana, H, J., Jr.. Gag Ho, S. s., a Stockmaster, H. 
(19BO, October). Analysis jf weapons controller course ellilnees . Unpublished manuscript* 
Capt Ben Granade, 3625 Technical Training Squadron. Tyndall AFB, FL 32403-5000. 

A meeting of representatives from the trelnlng and air weapons controller career management 
communities and Air Fore Headquarters (USAf/XOORC) was held on 29 and JO Sep 19BI at 
Wright-Patterson AFB, OH. The purpose of the meeting was to consider alternative solutions 
to air weapons controller training cost and attrition rate Issues. Four options were 
discussed: (a) raise performance standards (and, thereby* the attrition rates In the basic 
schools), to decrease downstream attrition and minimize the nir'er of "marginal performers* 
who enter operational unltss (p) establish minimum aptitude entrance standards; (c) use a 
combination of the first two alternatives; and (d) generate a Request for Personnel Research 
for AFHRL development of a special selection test battery for thl* career field. The last 
option Involved the Investigation of a psychomotor device previously developed for pilot 
selection, the development of experimental paper-and-pencll £ests, or the development of a 
totally new psychomotor device. Those attending the meeting chose Ootlon b. 

Some of the training school representatives requested consideration of data on sex and race 
as possible predictors of training performance. These data were collected, but are not 
presented because their use as selection criteria Is not feasible. Analysis of these data 
Indicate that neither race nor sex had consistently significant correlations with training 
program oerfornance. 
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APPENDIX A: T7XX TRAINING ORGANIZATIONS AND COURSES 



B , 



I C, 



3625 Technical Training Squadron, Tyndall AFB, FL (Air Training Command) 

I, E3OBP-I74IX-O00 Air Weapons Controller Fundamentals - 6-week training course for 
personnel initially entering the career field 
for later assignment to automated operational units. 

2* E30BP-1741A-003 Air Weapons Controller Fundamentals HanuaU 13-week course for 

personnel initially entering the career field for later assignment to manual 
operational units. 

USAF Interceptor weapons School, Tyndall AFB, FL (Tactical Air Command) 

174IB0O — TO- week course for students who have completed basic manual system 
training. Provides automatic posftionalTy qualified (APQ) training as intermediate 
training for students transitioning into units with automatic equipment (SAGE/BUI C/ 
AWACSh 

966 Airborne Warning and Control Squadron, Tinker AFB, OK (Tactical Air Command) 

1* E3AO0CO0BX — 16-week training program for AHACS Senior Directors/ 
Mission Crew Commanders, 

1. E3A00C0ODX — 24-week training program for AW ACS tfeapots Directors. 

3» E3A0OCOQGX — 19-week training program for AHACS Air Surveillance Officers, 

49S0 Technical Training tffng, KeesTer AFB, MS (Air Training Command) 

30LR1741D-OO? — 6-week training program in Electronic Counter- Counter Measures 

(ECCH) 

607 Technical Training Squadron, Luke AFB* AZ (Tactical Air Command) 

I741-FOL — 7-week training program in automated 407L radar system 
for students being assigned to operational units with this equipment* 
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